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Abstract —This paper considers a problem of output agree¬ 
ment in heterogeneous networks with dynamics on the nodes 
as well as on the edges. The control and disturbance signals 
entering the nodal dynamics are “unmatched” meaning that 
some nodes are only subject to disturbances, and are deprived of 
actuating signals. To further enrich our model, we accommodate 
(solvable) algebraic constraints in a subset of nodal dynamics. 
We show that appropriate dynamic feedback controllers achieve 
output agreement on a desired vector. We also investigate the 
case of an optimal steady-state control over the network. The 
proposed results are applied to a heterogeneous microgrid. 

I. Introduction 

Agreement on a certain quantity of interest plays a central 
role in cooperative control. The most notable instances 
are distributed optimization [16], consensus [13], formation 
control [12], and synchronization, see e.g. [14], [11], [15]. 

The study of output agreement/regulation problem in the 
presence of disturbances has been motivated by numerous 
applications in balancing demand and supply, power net¬ 
works, and hydraulic networks. In this framework, the de¬ 
mands/loads are interpreted as external disturbances affecting 
the network dynamics, see e.g. [6], [4], [7], 

In this paper, we consider agents with non-identical non¬ 
linear port-Hamiltonian dynamics; see [18] for more infor¬ 
mation on port-Hamiltonian systems. The nodal dynamics 
is subject to constant disturbances. In addition, we consider 
that a subset of nodal dynamics is governed by algebraic 
constraints. These constraints could be the result of mismatch 
in the dynamic order of the agents, or an approximation of 
fast subdynamics in singularly perturbed models [10]. The 
algebraic constraints we consider here are solvable meaning 
that they can be expressed in terms of other state variables 
of the network. However, obviously, the presence of such 
constraints adds to the heterogeneity of the network, and 
complicates the analysis. 

We consider the physical coupling to be “undamped”, and 
given by a single integrator with a nonlinear output map. We 
first show that an equilibrium of the network, if exists, is at¬ 
tractive and thus output agreement is locally achieved for the 
network. Next, we include controller dynamics on the nodes 
to guarantee output agreement on a prescribed set point, in 
the presence of physical coupling and disturbance signals. 
Another important feature here is that we treat an unmatched 
control-disturbance scheme, meaning that control signals and 
disturbances may act on different subsets of nodes. As a 
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case study, we consider a heterogeneous microgrid consisting 
of synchronous generators, droop-controlled inverters, and 
frequency dependent loads, where the goal is to guarantee a 
zero frequency deviation for all the nodes of the grid. 

Note that the main contribution of the current manuscript 
is to consider simultaneously i) multivariable nonlinear nodal 
dynamics, ii) dynamic physical coupling, iii) algebraic con¬ 
straints, and iv) unmatched disturbances in the output agree¬ 
ment problem. Our analysis is implicitly based on passivity 
and incremental passivity property inspired by [1], [2], [5], 
[3], [17]. 

The analysis of output agreement problem is carried out 
in Section El whereas the control design is treated in Section 
ED Section m is devoted to the case study of microgrids. 
Conclusions are provided in Section [V] The formal proofs of 
the proposed results are collected in the appendix in Section 

m 

Notation Apart form the standard notation, we use the 
following conventional notation. We use superscripts for 
vectors and matrices to indicate their domain of definition. 
In particular, let Xj with j £ Ibe a set of vectors. Then, 
by x l we mean x l = c.o\{xj) with j G I, C X. For a set of 
matrices, we define A 1 = blockdiag(A,) with j G X^ C I. 
We remove the superscript in case X, = X. 

II. ANALYSIS 

We define a dynamical network on a connected undirected 
graph Q = (V. £). We partition the vertex set of Q into two 
distinct subsets, V := X = X[ UX 2 . To each vertex of Q, we 
associate the following port-Hamiltonian types of dynamics: 

Xi — (Ji Ri)^ T" T di) 1 G (la) 

0 = (Ji — Ri)S7 H n> i(xi) + Gi(oi + dt) iGl 2 (lb) 

y z = GjX?H n ,i(xi) tGl (lc) 

where Xi G 1", Ji is a skew symmetric matrix, Ri is a 
positive definite matrix, cu G R m amounts for the physical 
coupling, di G R r " is a constant vector, and the Hamiltonian 
//,, , : R n —> It is strictly convex in an open convex set 
Q n C 1" for each i. 

To each edge of Q, we associate the following dynamics: 

Vk = v k (2a) 

ftfc — (jlk) (2b) 

where r]k G K m , the Hamiltonian H e ^ : R m —» M is 
strictly convex in an open convex set il,, C R m , and 


(3) 


k = 1,2,..., M. The interconnection law is given by 

v = (B T 0 I m )y, cr = —{B 0 I m )n 

where B is the incidence matrix of Q, v = col(xfc), y = 
col (yf), and cr = col(cTi) with k = 1,2, ...,M and i = 
1,2,. ..,1V. 

Then, the edge dynamics (0, the nodal dynamics 0. and 
the interconnection law 0 can be written compactly as 


77 = (B t (8 I)G T S7H n {x) 

(4a) 

p = VH e (ij) 

(4b) 

x 1 = (J 1 — i? 1 )ViT^(x 1 ) 


— G 1 {B 1 <8 I)VH e {rj) + G 1 d 1 

(4c) 

0 = (J 2 -R 2 )SJHl{x 2 ) 


- G 2 {B 2 0 /)ViT e (p) + G 2 d 2 

(4d) 

V = G T SJ H n (x) 

(4e) 


where B 1 and B 2 denote the submatrices obtained from B 
by collecting the rows indexed by Ii and T>, respectively. Let 
x = co^x^x 2 ) and d = co^d 1 ,^ 2 ). Suppose that (x,p) G 
(£l n ) N x (fl e ) M is an equilibrium of system (0 with x = 0 
and fj = 0. Then, we have 


0 = (B t 0 7)G t V7T„(x) 

(5a) 

0 = {J 1 ~ R^Hlfx 1 ) 


— G 1 (H 1 0 1)S7H e {fj) + G 1 d 1 

(5b) 

0 = {J 2 - f? 2 )VfT 2 (x 2 ) 


- G 2 (B 2 0 1)VH e (fj) + G 2 d 2 . 

(5c) 


Observe that the equation (Bal l yields an output agreement 
condition 

Gf\7H n!i (xi) = Gj\7H n j(xj), \fi,j G 1. ( 6 ) 

Hence, we obtain that G T ViT„(x) = Hat 0 y* for some 
constant vector y* G M n . The other two equations can be 
written together as 

0 = ( J - R)VH n (x) - G{B 0 I)VH e (fj) + Gd. (7) 
This implies that 

1 N ®y* = G T (J - R)~ 1 G((B 0 I)VH e (fj) - d). ( 8 ) 

In case the matrix G is equal to the identity matrix, by 
multiplying both hand sides of 0 from the left by ( 1 ^ <8 
In)(J ~ R), we obtain that 

N N 

w = -£*- (9) 

i= 1 2=1 

Hence, y* = \7H n ^(xi) is computed as 

N N 

y* = -CE(Ji~ R i)r iy E d i- do) 

i= 1 i=l 

Then, noting that Hat 0 y* = ViT„(x), the constant vector 
x G (n n ) N is unique in this case. It is worth mentioning that 


in the case n = 1, we have J = 0, and is simplified to 

* _ i T d 

y i t ri- 

By replacing (ITOb in 0 with G = I, the term (B <8 
I)VH e (fj) is explicitly computed. Hence, fj G (H e ) M 
in general is not unique. However, in case the graph Q 
is acyclic, the incidence matrix B has full column rank, 
and thus fj is unique. Note that an equilibrium (x, fj) G 
(Sl n ) N x (n e ) M does not always exist, and in particular the 
feasibility conditions @ and 0 must hold. The following 
theorem investigates stability/attractivity properties of such 
an equilibrium, assuming that it exists. 

Theorem 1 Suppose that ( x,fj ) G (Cl n ) N x (f2 e ) M is an 
equilibrium of 0. Then there exists a region of state 
space, which includes ( x,fj ), such that any solution (x,r/) 
o /0 starting in this region asymptotically converges to an 
equilibrium of ©. and the output agreement condition © 
holds. 

Proof. See Appendix. 

Note that Theorem Q] implies that the network 0 reaches 
an output agreement providing that there exist constant 
vectors (x,fj) G (Tl n ) N x (f l e ) M satisfying ©, 0, and thus 
©. As the vector y* resulting from this agreement may be 
not the desired one, due to the dependency on the disturbance 
d, next we investigate the possibility to influence this vector 
by an appropriate control scheme. 

III. CONTROL 

In this section, we treat certain control problems related 
to network dynamics 0. To capture the heterogeneous role 
of the nodes, we further partition the nodal dynamics © as 

Xi — Ri)^i (Xj^j + Giio'i + Ui i G Z H 

Xi — (t/j Ri)VH U: i(Xi) + Gi(jJi + S-i) Z G ^12 

0 = (Ji — Ri)VH Uj i(xi) + Gi(ai + Ui + (^) i G X21 

0 = (Ji — Ri)\ 7 H n ^(xi) + Gi(ai + 5 ^) i G X22 

yi = GfVH n>i (xi) iel 

( 11 ) 

where T\ = In UI12,12 = I21 UI22,111 0 , and Gt has 

a full column rank for each i. Here, the u, components are 
treated as control signals which are applied to the nodes, and 
the Si s are constant disturbance signals affecting the nodal 
dynamics. Note that the nodes in I12 and I22 are not directly 
controlled, and therefore our treatment here incorporates the 
case of an unmatched control-disturbance scheme. 

Now, the overall network dynamics can be written as 

fj = ( B t < 8 1)G T X/H n {x) (12a) 

x 11 = (J 11 — i? 11 )VJT^ 1 (x 11 ) 

— G 11 (S 11 ( 8 1)VH e {rj) 

+ G 11 m 11 + G 11 (5 11 (12b) 

x 12 = (J 12 - R 12 )VH^ 2 {x 12 ) 

- G 12 (B 12 (8 I)VH e (rj) + G 12 S 12 
0 = (J 21 -i? 21 )V7T 21 (x 21 ) 


( 12 c) 



Proof. See Appendix. 


-G 21 (B 21 gi/jVBe^) 

+ G 21 u 21 + G 21 <5 21 (12d) 

0 = (J 22 -B 22 )VB 22 (x 22 ) 

- G 22 (B 22 <g) I)VH e (y) + G 22 5 22 (12e) 

y = G T VH n (x). (12f) 

Our goal here is to design dynamic feedback controllers 

u 11 and u 21 such that output agreement <[ 6 ]> is guaranteed 
for the network, for a prescribed vector y*, in the presence 
of network coupling and disturbance signals. If such u 11 
and u 21 exist, we say that the output agreement problem is 
solvable. Obviously, this may not be always plausible, and 
by (fl 2 l > we obtain the following feasibility condition 


1 ®y* = G T VH n {x) (13a) 

0 = (J 11 -R 11 )Vffi 1 (x 11 ) 

— G 11 (B 11 0 I)VH e (fj) 

+ G u u u + G n S n (13b) 

0 = (J 12 - R 12 )VH} 2 (x 12 ) 

-G 12 (B 12 ®I)\7H e (fj) + G 12 6 12 (13c) 

0= (J 21 -B 21 )Vtf 21 (x 21 ) 

-G , 21 (B 21 ®I)VH e {fj) (13d) 

+ G 2 V 1 + G 21 5 21 
0 = (J 22 - R 22 )\7H 22 (x 22 ) 

- G 22 {B 22 ® I)VH e (fj) + G 22 5 22 (13e) 


Clearly, this boils down to the following condition. 
Feasibility condition: there exist constant vectors x G 
(Cl n ) N , fj G d 11 , d 21 such that 

1 ®y* =G T VH n {x) (14a) 

0 = (J 11 - R ll )S7Hi 1 (x 11 ) 

— G 11 (B 11 ® I)S7H e {fj) + G 11 ^ 11 (14b) 

0 = (J 12 - R 12 )VHl 2 (x 12 ) 

— G 12 (B 12 ® I)\7H e (fj) + G 12 S 12 (14c) 

0 = (J 21 ~ R 21 )X7H 21 {x 21 ) 

-G 21 (B 21 ®I)VH e (fj) + G 21 d 21 (14d) 

0 = (J 22 - R 22 )X7H 22 (x 22 ) 

— G 22 {B 22 ® I)VH e (fj) + G 22 6 22 (14e) 

Note that we have used the fact that fj is constant, and G 11 
and G 22 are full column rank. Now, we have the following 
result. 

Theorem 2 Consider the decentralized controller 

ii=y* - GfWH n>i (xi) (15a) 

Ui =& (15b) 

with i G In UI 21 . Assume that the feasibility condition d 

holds, and let £ = col(^) and £ = col(cr,cr). Then, there 
exists a region of state space, including (x , fj , ^), such that 
any solution ( x , y, £) of the network asymptotically converges 
to an equilibrium of <U3 and (U3, in which G*V H n ^{xi) = 
y* for each i G V. 


Remark 3 Note that in case the controller at a node i G In 
or i G I21 does not have access to the desired output y* , one 
can set Ui to a constant, namely a nominal value, and incor¬ 
porate the node i in the subdynamics of dill corresponding 
to the nodes indexed by I 12 or I 22 , respectively. 

In Theorem [2] the control input u has been designed such 
that output agreement on a prescribed vector y* is achieved 
for the network. Observe that the “steady-state” control 
signal u = £ is primarily determined by the initialization 
of the system/controller. Next, under the constraint of output 
agreement we aim to minimize the following quadratic 
cost function 

min = - y* ujQiUi (16) 

u Z L —* 

idle 

where Qi G R m x K. m is a positive definite matrix for each 
i, and I c = In U I 21 . Note that the optimization above 
determines the steady-state distribution of the control effort 
over the agents of the network. This is particularly relevant 
in applications involving demand and supply balancing, 
including power as well as hydraulic networks; see e.g. [4], 
[ 6 ]. 

To make the analysis more concise, we restrict our atten¬ 
tion to the case where Gj = / for each i. Then, similar to 
©, we obtain the following constraint 

N N 

J2( J i- R i)y* + J2 Ui + J2 Si = o- (17) 

2=1 ieX c 2—1 

By standard Lagrange multipliers method, the vector u which 
minimizes (IT 6 l) subject to (IT7l) is obtained as 

Hi = Qf l X (18) 

where A E M n is given by 

N N 

A = -(E Qr 1 )" 1 (E( J * - w + E *)■ (i9) 

iez c 2=1 2=1 

It is easy to observe that, by (IT3l > and ( 1 1 Si . we obtain the 
following feasibility condition in this case. 

Feasibility condition with optimality: For a given y* G f l n , 
there exists a constant vector fj G (fl e ) M such that 


0 = 

-(J 11 

- 

R 11 

)(1 

®y*) - 

- (B 11 


< 

TO 

3? 




+ 

(Q 11 )- 1 

(1 (g) A) + <5 n 



( 20 a) 

0 = 

= ( J 12 

- 

R 12 

)(1 

®y*) ~ 

-(B 12 


I)VH e (fj) + S 

■12 










( 20 b) 

0 = 

= (J 21 

- 

R 21 

)(1 

®y*) - 

-(B 21 


< 

3? 




+ 

(Q 21 )- 1 

(1 g) A) + 5 21 



( 20 c) 

0 = 

= (J 22 

- 

R 22 

)(1 

®y*) - 

- (B 22 


I)VH e (fj) + 6 

22 










( 20 d) 


where A is as in (IT9l) . 


To achieve output agreement problem with an optimal 
“steady state” control input, we propose a distributed con¬ 
troller at the nodes. The communication among the con¬ 
trollers takes place over a communication graph, say Qc = 
(V c ,£ c ), which is undirected and connected. 

Theorem 4 Assume that the feasibility condition <ED holds. 
Consider the distributed controller 

ii= Y, - &) + Qr V - *)) (21a) 

Ui = ( 21 b) 

with i £ In U I21. Let £ = co 1 (£l), and let the constant 
vector f be chosen as £ = 1 <g> A where A is given by (ED- 
Then, there exists a region of state space, including ( x,fj ,£), 
such that any solution ( x , 77, £) 0/ the network starting in 
this region asymptotically converges to an equilibrium of 
<ED and (ED, in which V H n ^{xf) = y* for each i £ V. 
Moreover, in this region, Ui asymptotically converges to the 
optimal Hi given by Ell- 

Proof. See Appendix. 

IV. Case study 

We consider a (fairly) general heterogeneous microgrid 
which consists of synchronous generators, droop-controlled 
inverters, and frequency dependent loads. We partition the 
buses, i.e. the nodes of Q, into three sets, namely V G , Vj, 
and Vl, corresponding to the set of synchronous generators, 
inverters, and loads, respectively. 

The dynamics of each synchronous generator is governed 
by the so-called swing equation, and is given by: 

Midi = —AiOi + Ui — Pi + Si, i £ Vg, (22) 

where 

Pi= Y, ^(YijWVjsmiei-dj) (23) 

is the active nodal injection at node i. Here, M r > 0 is the 
moment of inertia, Ai > 0 is the damping constant, Ui is 
the local controllable power generation, and Si is the local 
load at node i € Vg. The value of Y Lj £ C is equal to the 
admittance of the branch {i,j} £ £, and 0, is the voltage 
angle at node i. Also, Vi is the voltage magnitude at node i, 
and is assumed to be constant. 

For the droop-controlled inverters, we consider the follow¬ 
ing first-order model 

Aidi = Ui - Pi + Si , i £ V/ (24) 

where Ai is known as the droop coefficient, u, is the injection 
power at node (inverter) i. Si is the local load at inverter i, 
and 9i indicates the frequency deviation from the nominal 
frequency of the network, 1 £ V/- The term P, has the same 
expression as in (ED- 

As for nodal dynamics corresponding to the loads, we 
consider frequency dependent loads given by the first-order 
system 

Aidi = Si — Pi , 


Again, here di is the frequency deviation. A, > 0 is the 
damping coefficient, Pi is given by (ED , and Si is the 
constant power consumption at node i £ Vl- 

To write the system in a compact form, we need the 
following nomenclature. For each * = 1,2,..., k, let 7 *, be 
defined as 7 = (Im Y-ij)V.Vj with {i,j} being the k th edge 
of the graph, where the edge numbers are in accordance 
with the incidence matrix B. We define the diagonal matrix 
r as r = diag( 7 j), with j = 1,2,... ,k. Let the matrices 
Bg, Bi, and Bl be obtained from B by collecting the 
rows indexed by Vg, Vi, and Vl, respectively. We define 
the vectors and matrices Mg, A g , d G , and u G , as M G = 
diag(Mi), A g = diag(Ai), d G = co 1 ( 6 >l), u G = coI(ul), 
and Sq = col(<5,) where i £ Vg- The vectors and matrices 
Ai, di, and ui are defined as Ai = diag(Ai), di = col(0j), 
ui = col(rti), and Sq = col(<5j) with i £ V/. In addition, 
let Al = diag(A,), 9l = col( 0 .;) and Sl = col(<5i) where 
i £ Vl- Finally, let P = col (Pi), d = co1($g, di, 9 l), and 
siri(a;) := col(sin(iTi)) for a given vector x. Then, it is easy 
to observe that the dynamics of the synchronous generators, 
the inverters, and the loads can be written compactly as: 

M g 6 g + A G d G = -B G Tsm(B T d) +u G -S G (26a) 
Aidi = -BiTsm{B T d ) + ui - Si (26b) 

A L d L = -B L Tsm{B T d) + S L (26c) 

Note that this is the same model as [ 8 ], see also [19]. By 
defining 77 = B T d, uj g = d G , uii = di, ojl = 9l, and d = 
lo = col( wg,w;,wl), the network dynamics (l26l >. admits the 


following representation 

77 = B t uj (27 a) 

M g oj g + A g oj g = -B G Tsm(n) + u G + S G (27b) 
Aiuji = —BiTsmfi) + ui + Si ( 27 c ) 
A l oj l = --Bi,rsin(? 7 ) + S L (27d) 

Now, let p G = M g wg, H g = \p T G Mf} VG , Hi = \ojJoji, 

Hl = \wJ^wl, and H e = —t T T cos (ri). Then, (ED can be 
written as 

77 = B T VH T (p) (28a) 

p G = -A g VH g (pg) - B G VH e {rj) + u G + S G (28b) 

0 = -A/ViT/(w/) - Bi\/H e (r]) + U 1 + S 1 (28c) 

0 = -AlV/Hl^l) ^ B L VH e (ri) + S L (28d) 


where p = col (p g ,oji,ujl) and Ht = H G + Hi + Hl- 

Note that d28l > has a similar structure/properties as (ED, with 
Ll n = R, fl e = (—§, §), and I 12 = 0. The primary control 
goal here is to achieve a zero frequency deviation for the 
power network. As VTTt = w, this is in accordance with 
our definition of output agreement with y* = 0. Moreover, 
we would like to achieve an optimal steady-state distribution 
of the power in the sense of (ED- In this case, (ED reads as 

Ui = qf 1 A (29) 

where 

A = -(519i) _1 (l T $g + 1 T Si + t t S l )- 


»£ Vl 


(25) 


Observe that the feasibility condition (l20l) in this case 
amounts for the existence of a constant vector fj £ (—f, f ) A/ 
such that 

0 = -B G VH e (fj) + u G + Sg (30a) 

0 = —Bj\/H e (fj) + ui + Si (30b) 

0 = -B L VH e {fj) + 6 L (30c) 

where Ui is given by (l29l > for each i £ VgUV/. Now, assume 
that the feasibility condition (l30l) holds. Then, by Theorem 
[4j the controller 

ii= E (31a) 

{* >i}e£c 

«i = «r 1 6. * e V G u V/ (31b) 

achieves zero frequency deviation , and moreover Uj asymp¬ 
totically converges to the optimal Ui given by (129b . 

Now, consider the case where a proper subset of genera¬ 
tors, say Vf C Vg, encounter some failures. In particular, 
assume that m is not appropriately actuated, and is equal to 
some unknown constant vector for each i £ Vf- Then, for 
the nodes in the fail mode, subdynamics (128bb reads as 

PF = -A f VHf(pf) - B F VH e (n ) + S F (32) 

where we have used the index “F” to distinguish the subdy¬ 
namics above from the nominal subdynamics (128bb . Assume 
that there exists p £ (— j, f) M such that (l30b and 

0 = -B F VH e (fj) + S F 

are satisfied. Note that (130al) has to be modified accordingly 
to exclude the faulty generators. Observe that (l32b has the 
same structure as (112cb . Then, by Theorem [4] we conclude 
that the controller (OH achieves a zero frequency deviation, 
and we have optimal steady state distribution of the power, 
given by (l29l ). despite the failures in the nodal dynamics Vg- 

Note that, similarly, absence or failure of actuation in 
inverters can be incorporated in our design, as this results 
in a similar dynamics to that of the loads. 

V. Conclusions 

We have investigated the problem of output agreement 
in heterogeneous networks with port-Hamiltonian nodal 
dynamics, dynamic physical coupling, and algebraic con¬ 
straints. We have considered the case where control and 
disturbance signals may act on different subset of nodes. We 
have observed that the equilibrium of the network, if exists, 
is locally attractive, and thus output variables asymptotically 
converges to a same vector. As discussed, this vector can be 
steered to a desired one by applying decentralized dynamic 
controllers at the nodes, upon the satisfaction of certain 
feasibility conditions imposed by the physics of the problem. 
We have also studied the case in which we are interested in 
an optimal steady-state distribution of control signals over the 
network. As observed, this goal can be achieved by exploit¬ 
ing distributed controllers at the nodes. We have applied the 
proposed results on a heterogeneous microgrid. Extending 
the analysis to incorporate time-varying disturbances is a 
subject of future research. 


VI. Appendix 

Poof of Theorem |T| From (l4ai we have 

p = (B 1 ®I) T (G 1 ) T VHl{x 1 ) + (B 2 ®I) T (G 2 ) T VH 2 n (x 2 ) 

(33) 

By (gdji, we obtain that 

p=(B 1 ®I) T (G 1 ) T VH 1 n (x 1 ) 

+ (B 2 ® lf(G 2 f(J 2 - R 2 )-^ 2 
■((B 2 ®I)S7H e (p)-d 2 ) 

Next, we study the asymptotic behavior of the following 
subdynamics of (Q} 

p={B 1 ®lf{G 1 ) T VH 1 n {x l ) 

+ ( B 2 <g> lf(G 2 f(J 2 - R 2 )~ 1 G 2 (B 2 ® J)VH e (tj) 

- {B 2 ® lf(G 2 f(J 2 - R 2 )~ 1 G 2 d 2 ) (34a) 

x (1) =(J (1) -f? (1) }VfT^ 1) (x (1) ) 

- G 1 (B^ <g> I)VH e {p) + G (1) d (1) (34b) 

Let W n and W e be defined as 

Wnix 1 ,^ 1 ) = H^x 1 ) - H^x 1 ) - (V7T^(5 1 )) T (a; 1 -x 1 ) 


W e (p,p) = H e {rj) - H e (rj) - ( X7H e {p)f{p - p) (36) 

where (x [ , fj) is an equilibrium of ( 1391 . Following [9], W n 
identifies a positive definite map with a strict local minimum 
at x 1 = x 1 . Also W e defines a positive definite map with a 
strict local minimum at p = fj. Noting that x = 0, we have 

W n =(V^(x 1 )) T x 1 - (VH^fix 1 - i 1 ) 
=(VH i(x 1 )-V^(* 1 )) r (i 1 -5 1 ) 

■(J 1 -It 1 )(VffZ(x 1 )-VHfe 1 )) 

-(Vff^xf-VII^xff 

■ G 1 (B 1 ® I){S7H e (p) - X7H e (fj)) 

In addition, noting that fj = 0 we have 

W e =(VH e (p)) T p - (V H e (p)f (p - fj) 
=(VH e (p)~VH e (fj)f(p-fj) 

=(VH e (p) - VF e (p)) T (B 1 ® If 

■(G 1 ) t (VJT1(* 1 )-V^(* 1 )) 

+ (VHfp) - VH e (p)f(B 2 ® lf(G 2 f 

■ (J 2 - R 2 f 1 G 2 (B 2 ® I) (V He (p) - Vff e (jj)) 

(37) 


Let Wt '■= W n + W e . Then, we have 
W T = (VH^x 1 ) - Vffi(x 1 )) T (J 1 - R 1 ) 

■ (ViT^x 1 ) - VH^x 1 )) 

+ (\7H e (p) - \7H e (fj)f(B 2 ® lf{G 2 f 

■ ( J 2 - R 2 )~ 1 G 2 (B 2 ® I)(VH e (p) - VHffj)) 






where we have used the fact that d 1 and d 2 are constant. 

Now, note that for any skew-symmetric matrix J and a 
positive definite matrix R, we have —2R = (J — R) + (J — 
R) t < 0, and thus (J — 7 ?) _1 + (J — R)~ T < 0. Hence, 
z T (J — R)z < 0 and z T (J — R)~ 1 z < 0 for any nonzero 
vector z. Therefore, we conclude that Wt ^ 0. 

Observe that Wt has a strict local minimum at x - x 1 
and 77 = fj, and hence one can construct a compact level 
set C (Q n pl x ( fl e ) M around (x 1 , 77) which is forward 
invariant. This implies that on the interval of definition of a 
solution to system ©, the variables X 1 and 77 are bounded. 
Hence, by (l4dl >. the variables V77 2 (x 2 ) are also bounded, 
and a solution to © exists for all t. 

Then by invoking LaSalle invariance principle, on the 
invariant set Wt — 0 , we have 

VTpx 1 ) - VTd^x 1 ) = 0 (38a) 

G 2 {B 2 ® I)(VH e (ji) - VH e (fj )) = 0. (38b) 

Due to the strict convexity of H ( 13 8 al l yields x 1 = x 1 . 
Besides, (I34ab admits the following incremental model 

V = (B 1 <g> J) T (G 1 ) T (VfTi(x 1 ) - VTpx 1 )) 

+ (B 2 <g> I) t (G 2 ) t (J 2 - R 2 )- 1 

■ G 2 {B 2 ® J)(V7T e (?7) — V7T e (?7)) 

Therefore, by (l38l >. we obtain that 77 = fj on the invariant set 
for some constant vector fj, and thus output agreement © 
holds. Note that, by (l4dl >. x -2 asymptotically converges to a 
constant vector identified by 

V77 2 (x 2 ) = (J 2 — R 2 )~ 1 G 2 ((B 2 ® I)VH e (fj) + d 2 ) (39) 
This completes the proof. ■ 


the solution of which exists and is unique. Moreover, this 
system admits the following incremental model. 


77 - fj = (B 11 ® J) T (G 11 ) T (VfT 11 (x 11 ) - V77 n (x n )) 

+ (B 12 <g> 7) T (G 12 ) T V(77 12 (x 12 ) - 77 12 (x 12 )) 

+ (B 21 <g> 7) T (G 21 ) T ( J 21 - R 21 )~ 1 G 21 

■ (B 21 ® I)(VH e (r]) — VH e {fj)) 

- (B 21 <g> 7) T (G 21 ) T ( J 21 - 7? 21 ) - 1 G 21 (P - p) 
+ (B 22 <8> 7) t (G 22 ) t ( J 22 - R 22 )~ 1 G 22 

■ (B 22 ® 7)(V77 e (?7) - X7H e (fj)) (42a) 


in _ jit = (J 11 _ 7jii)(V77„i(xii) - VTTpx 11 ) 
- G 11 (B 11 ® 7)(V77 e (T7) - V77 e (T7)) 


+ G iX (p — p) 


(42b) 


x 12 _ -12 = (Ji2 _ ip)(V77px 12 ) - V7p(x 12 )) 

- G 12 (H 12 ® I)(\7H e {rj) - VH e (fj)) (42c) 

P - I 11 = - (G 11 ) T (V77 11 (x 11 ) - VTTpx 11 )) (42d) 
P _ |21 = _ ( G 21)T (J 21 _ ^lj-l^l 

• (f? 21 ® 7)(V77 e (?7) — V77 e (?7)) 

+ (G 21 ) t (J 21 - 7? 21 ) _1 G 21 (P - P) 

(42e) 


where p = d 11 — d 11 , P = d 21 — <5 21 , and constant vectors 
x and 77 are such that i l 1 41 ) is satisfied. Note that, due to the 
feasibility condition, (x, fj, u ) is a valid solution for G3, 
where u = col(tt n , w 21 ), it 11 = p, and u 21 = P. 

Now consider the Lyapunov function V = W n + W e + W c 
where 


Proof of Theorem [ 2 j By the algebraic equation (1 1 2db . the 
controller (fT 5 l i can be written as 


P = 1 ® y* - (G 11 ) t V77 11 (x 11 ) (40a) 

P = 1 0 y* - (G 21 ) t (J 21 - iPpG 21 

• ((7 ? 21 ® 7)V7J e (?7) - p - 5 21 ) (40b) 

it 11 = p (40c) 

u 21 =P. (40d) 


Moreover, by (1 1 2ab . (1 1 2db . and (1 1 2eb . we have 

77 = {B 11 ® 7) t (G 11 ) t V77 11 (x 11 ) 

+ (H 12 ® 7) T (G 12 ) T V77 12 (x 12 ) 

+ (B 21 ® 7) T (G 21 ) T ( J 21 — 7? 21 )" 1 G 21 
•(p 21 0 7)V77 e (T7)-P-P) 

+ (B 22 ® 7) T (G 22 ) T ( J 22 - TppG 22 

•((H 22 ®7)V77 e (T7)-P) (41) 

The equation above together with (1 1 2bb , (1 1 2cb . and ( 140b de¬ 
fines a dynamical system with ordinary differential equations. 


wt=i({ n -{‘tk 11 -{ n )+p - -?■) 

(43) 

and W n and W e are given by (l35l > and (l36b . respectively. By 
the use of incremental model (|42T >. we obtain 

W n =(V7p(x n ) - vpppfP 1 - i 11 ) 

+ (V77px 12 ) - V7p(x 12 )) T (x 12 - i 12 ) 
=(VH^(x n ) VH* 1 (x 11 )) t (J 11 - R 11 ) 

■(VHfCx^-VB^x 11 )) 

~ (VTTpx 11 ) — V77^ 1 (x 11 )) t (G 11 ) 

• (B 11 <g> I)(VH e (ji) — \7H e (fj)) 

+ (VTf^p 1 ) - V77^ 1 (x 11 )) t G 11 (^ 11 - e 11 ) 

+ (VTTpx 12 ) - V77^ 2 (x 12 )) T ( J 12 - 7? 12 ) 

' (V77^ 2 (x 12 ) — V77^ 2 (x 12 )) 
pVT7px 12 )-V77px 12 )fG 12 

• (H 12 ® 7)(V77 e (T7) - V77 e (T?)) (44) 





and 


We = (Vflefa) - VH e (fj)f(B n ® if 

• {G n f(VH n (x n ) - VfT 11 ^' 11 )) 

+ (Vff e ( t; ) - VH e (fj)) T (B 12 ® if 

• (G 12 ) T (Vi? 12 (x 12 ) - 7T 12 (5 12 )) 

+ (VF e (r?) - Vtf e (?7)) T CB 21 ® lf(G 21 f 

• (j2i _ i? 21 )- 1 G 21 (B 21 ® I)f7H e (r]) - VHffj)) 
- (VH e ( v ) - VH e (fj)f(B 21 ® if (G 21 f 

■{J 21 -R 21 )- 1 !! 21 ^ 21 -? 1 ) 

+ (yHfi 7 ) - VH e f)f(B 22 ® If (G 22 ) t 

• (J 22 - R 22 )~ 1 G 22 (B 22 ® I)(VH e (rt) - VH e (f})) 

(45) 


Then, Wc is computed as 



11 

21 


e 11 ) T (G 11 ) T (V7J 11 (a; 11 ) - VTI 11 ^ 11 )) 
e 21 ) T (G 21 ) T (J 21 -i? 21 )- 1 G 21 


■(B 21 ®I)(VH e (r])-VH e (f))) 


+ (r - T ) (G ) (J 2i - _ ^i) 


Hence, we have 

v = w n + w e + w c 

=(VHf(x n ) - V^ 1 (x 11 )) T (J 11 - R 11 ) 

■ (VHff 11 ) -VHfix 11 )) 

+ (VHf{x 12 ) - VHf{x 12 )f (J 12 - R 12 ) 

' (yHf(x 12 ) — VHf(x 12 )) 

+ (VH e {rj) - VH e (fj)f(B 22 ® lf(G 22 f 

■ ( J 22 - R? 2 )- 1 G 22 (B 22 ® I)f7H e {n) - VHffj)) 
+ z T (J 21 -R 21 )-^ 


where 


2 = G 21 (B 21 ® I)fJH e {rj) - VH e (f})) - G 2l f 21 - f l ) 

Consequently, V ^ 0. Note that 


is a strict local minimum of V, and thus one can construct 
a compact level set around this point which is forward 
invariant. This implies that on the interval of definition of 
a solution to system (0}, the variables x 11 , x 12 , p, £ n , and 
£ 21 are bounded. Therefore, by (1 1 2db and (1 1 2cb . the variables 
V7T 21 (a; 21 ), V H 22 (x 21 ) are also bounded, and a solution to 
El» exists for all t. Now by invoking LaSalle invariance 
principle, one the invariant set V = 0, we have 

VTT 11 ^ 11 ) = VfT 11 ^ 11 ), VH 12 (x 12 ) = Vf? 12 0r 12 ), 
G 22 (B 22 ® J)(ViT e (p) - ViT e (?7)) = 0 


and 


G 2 fB 21 ®I)(\/H e ( v ) - VH e (fj)) - G 21 f 21 - p 1 ) = 0 

Hence, by (142al >. we obtain that r] = fj = 0. In addition, by 
(142dl >. we have £ = £ = 0. Consequently, by (I40ab . we obtain 


that (G 11 fS7H 11 (x 11 ) = {G n fVH n (x n ) = l®j/*on 
the invariant set. This together with ?) = 0 implies that y-i = 
y* for each i G V. Again note that, by E3J-ED. x 21 and 
x 22 asymptotically converge to constant vectors x 21 and a; 22 
with similar expressions as in (l39l >. where the superscripts 
are modihed accordingly. This completes the proof. ■ 


Proof of Theorem 0} The controller ( 12 1 1 can be written in 
compact as 



(L c ® /) 


£ 

€ 


if 

21 


+ Q 1 


u 

u 


11 " 

21 


=Q _1 



1 ®y* 
t ®y* 


VH 11 (x 11 ) 

\7H 21 {x 21 ) 


(46a) 

(46b) 


where L c denotes the Laplacian matrix of Q c , Q = 
blockdiag(Qi) with i £ I c = In UX 21 , and in this case 


VH 21 (x 21 ) ={J 21 -R 21 )- 1 

• ((f? 21 <g> I)VH e (ri) - ( Q 21 ff 21 - S 21 ) 


The controller above admits the following incremental model 


-f" 

£21 — £ 21 


(L c ® I) 


e 1 - f 1 
£21 _ £21 


-Q- 1 


S/H 11 (x 11 ) - 
VH 21 (x 21 ) - 


V 1 - u ir 

_ G)— 1 

'e 1 - 

u 21 - u 2 \ 

— Q 

£21 _ £21 


where 


VTT 11 ^ 11 )' 

yH n lx 21 ) 

(47a) 

(47b) 


S7 H 21 (x 21 ) — X7H 21 (x 21 ) 

= (J 21 - R 21 )-\B 21 ® I)(V7T e (p) - VTT e (i7)) 


The incremental system dynamics in this case is given by 

V-fj= (B 11 ® lff7H 11 (x 11 ) - VH 11 ^ 11 )) 

+ (B 12 ® lf{S7H 12 {x 12 ) - VH 12 (x 12 )) 

+ (B 21 ® lf(J 21 - R 21 )-\B 21 ® I) 

■ (VH e ( v ) - VH e (fj )) 

- (H 21 <g> If{J 21 - i? 21 ) _1 (Q 21 ) _1 (^ 21 - £ 21 ) 
+ (B 22 ® lf{J 22 - R 22 )-\B 22 ® I) 

■ f7H e (rj) - VHffj)) (48a) 


* n - x 11 = (J 11 - R^iVHfix 11 ) - VHfix 11 )) 

- (B 11 ® I)(VH e (ri) — Vi7 e (p)) 

+ (Q n ) -1 (£ n -f 11 ) (48b) 

x 12 - sc 12 = (J 12 - i? 12 )(ViT^ 2 (a; 12 ) - VHf(x 12 )) 

- ( B 12 ® I)(S/H e (rj) - VH e (f})) (48c) 

Now, let 

f 1 = t ® A, f 1 = t ® A (49) 






















where A is given by ( IT9t . By ( l49l >. we have u, = Q~ 1 A 
which coincides with it,; given by (fl8l) . Hence, by (l20t . it is 
easy to observe that ( x , f},£) defines a valid solution to (1 1 21 . 

Now consider again the Lyapunov function V = W n + 
W e + W c where W n , W e , and W c are given by (f35l> . (l36l ). 
and (143b . receptively. Then it is straightforward to investigate 
that 

V = (ViT“(^ n ) - VH* 1 (x 11 )) t (J 11 - R 11 ) 

+ (Vfr“(* 12 ) - v^ 2 (s 12 )) t (j 12 - r 12 ) 

• (VT^* 12 ) - Vf£V 2 )) 

+ (VH e ( v ) - X7HM) T (B 22 ® J) T ( J 22 - f? 22 )- 1 

• (L ? 22 <g> I)(\7H e (rj) — VH e (fj)) 

- £ t (L c ® 7)| + z T ( J 21 - i? 21 )- 1 * 

where £ = col(£ n — £ n ,£ 21 — ? 21 ) and 

* = (H 21 0 I)(S7H e ( V ) - V7f e (ij)) - (Q 21 )- 1 ^ 1 - P 1 ) 

Hence, we obtain that V ^ 0. Note that boundedness, 
existence, and uniqueness of solution is guaranteed in 
the same vein as in the proof of Theorem [2] Now by 
constructing a forward invariant compact level set around 
(a: 11 , x 12 , fj, £ n , £ 21 ), and invoking LaSalle invariance prin¬ 


ciple, on the invariant set we have 

VJ7 11 (x 11 ) — Vf7 11 (x 11 ) = 0 (50a) 

VH 12 {x 12 ) - S7H 12 (x 12 ) = 0 (50b) 

{B 22 ® I)(VH e (ri) - VH e {fj)) = 0 (50c) 

(L c ® I)i = 0 (50d) 

(B 21 0 J)(Vi7e( V) - VH e (fj)) - (Q 21 )” 1 ^ 21 - P) = 0 

(50e) 

Therefore, by (148ab . we have f) = rj = 0. Moreover, by 
(I47ab . (I50ab . and (150db . we obtain that £ n = £ n = 0 
on the invariant set. In addition, (150db implies that E, = 


1 ® a for some vector a. Replacing this into (146ab yields 
VfT 11 (x 11 ) = S7H 11 (x 11 ) = 1 ® y*. This together with 
i) = 0 results in j/j = y* for each t g V. Note that on the 
invariant set, p = p + 1 ® a = 1 0 (a + A). Similarly, 
we have P = 1 0 (a 4- A), and, hence the system dynamics 
takes the form 

0 = (J 11 - R n )( 1 ® y*) - (B 11 ® I)VH e (fj) 

+ (Q 11 ) -1 ! 0 (A + a) + J 11 
0 = (J 12 - f? 12 )( 1 0 y*) - (B 12 ® I)VH e (fj) + 6 12 
0 = (J 21 - f? 21 )(l ® y *) - (B 21 ® I)VH e (rj) 

+ (Q 21 ) -1 ! 0 (A + a) + 6 21 
0 = ( J 22 - R 22 ){t ® y*) - ( B 22 0 I)VH e (fj) + S 22 

where fj is a constant vector. By multiplying each of the 
equalities above from the left by 1 T 0 1 and taking the sum 
over all the resulting equalities, we conclude that 

N N 

x+a = qPPEw - w +E p 

i£Z c i=l 2=1 


By comparing the equality above to ( IT9b . we obtain that 

a = 0. Consequently, on the invariant set m is equal to the 

optimal Ui given by CH. ■ 
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